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The assembly and communication of multimedia informa- 
tion from a variety of modalities to remote users with 
improved control is provided for by the combined use of a 
browser enhancement module, such as a plug-in or ActiveX 
control, and a server TTie server includes a data interface for 
acquiring the multimedia data and a storage unit for receiv- 
ing and storing the data. An assembly unit in the server 
gathers selected data to form an e-mail package in response 
to instructions from a remote user unit. The server further 
includes a processing unit to encode and compress the data 
prior to packaging and an e-mail server to send the package 
to the remote user unit or another designated user unit. 
Transfer instructions for the server may be provided by the 
remote user unit through a browser and the browser 
enhancement module. The browser enhancement module is 
therefore configured to request a file from the server, to 
decompress and decode received files and to transfer such 
files along with a user interface to a display associated with 
the remote user unit. The browser enhancement module is 
further adapted to send instructions to the server to assemble 
and to e-mail selected data from a file to another user unit. 

58 Claims, 4 Drawing Slieets 
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MEDICAL NETWORK SYSTEM AND 
METHOD FOR TRANSFER OF 
INFORMATION 

NOTICE OF COPYRIGHT 5 

A portion of the disclosure of this patent document 
contains material which is subject to copyright protection. 
The copyright owner has no objection to the facsimile 
reproduction by anyone of the patent document or the patent 
disclosure, as it appears in the Patent and Trademark Office 
patent file or records, but otherwise reserves all copyright 
rights whatsoever. 

HELD OF THE INVENTION 

15 

The present invention relates generally to the transfer of 
multimedia information through the Internet, and more 
particularly to an integrated e-mail and server system for 
manipulating and communicating medical information. 

20 

BACKGROUND 

In many fields (e.g., medicine, manufacturing, veterinary 
science, scientific research, etc.), it is often necessary to 
examine a subject and communicate the results of the 
examination to a remote place. Such information exchanges 
are especially desirable in the medical arena where it is often 
useful for medical practitioners to communicate medical 
information, such as patient test results, to other practitio- 
ners located in remote places. Telemedicine facilitates this 
exchange of information, 

Telemedicine is an emerging field that enables medical 
knowledge to be shared amongst a variety of users that need 
not be co-located. Interest in telemedicine has exploded in 
the 1990's with the development of medical devices for 
capturing data in digital electronic form and the establish- 
ment of high speed, high bandwidth telecommunication 
systems around the world. In particular, the use of the 
Internet in telemedicine allows a practitioner at one location 
to interpret medical test results and consult with another 
practitioner located elsewhere. Medical information transfer 
systems that employ the Internet allow for remote locations, 
such as third world countries that do not have an attending 
specialist, to access such medical expertise. Furthermore, 
emergency care may be provided where a practitioner is 
temporarily away, e.g., at home or on vacation. See, e.g., 
Thrall JH, Boland G., "Telemedicine in practice". Seminars 
in Nuclear Medicine 28(2): 145-57, April 1998. 

Medical information (e.g., as may be utilized by a tele- 
medicine system) may be derived from many different 50 
medical modalities. Such modalities may include sophisti- 
cated radiology equipment grouped as small matrix size and 
large matrix size instruments. Small matrix systems include 
equipment for magnetic resonance imaging (MRI), com- 
puted tomography (CT), ultrasonography (US), nuclear 55 
medicine (NM) and digital fluorography. Large matrix sys- 
tems include equipment for computer radiography (CR) and 
digitized radiography (DR). Other data image acquisition 
equipment may be used for radiofluoroscopy, angiography, 
such as x-ray angiography and heart scanning. Still other go 
equipment of great usefulness in acquiring medical infor- 
mation includes secondary capture devices for video, 
endoscopy, microscopy, and photography, such as digital 
cameras, scanners, electrocardiogram (ECG) machines, and 
the like. 65 

The resulting medical information may take numerous 
forms, including text, images and video, or variations 
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thereof, such as image overlay data, measurements, 
coordinates, etc. Information may also be in the form of 
time-dependent data including sound, such as audio 
dictation, and waveform data. The data may be static rep- 
resentations of timedependent forms, such as curves. Thus, 
it is advantageous for telemedicine systems that may need to 
transfer the data and/or information to be flexible, so as to 
accommodate this variety of information/data from multiple 
modalities. 

Unfortunately, this type of flexibility is not exhibited in 
current systems. For example, some current medical infor- 
mation transfer systems have integrated medical modalities 
to not only generate data but also to capture data signals, to 
store the data and to transmit the data over the Internet. 
Typically, in such systems the modality has an integrated 
Web server, storage database and Web pages as physical 
parts of the modality system. A remote Web browser is 
allowed to request data from the modality through the 
Internet (e.g., via the World Wide Web) and the Web server 
in the modality is allowed to respond accordingly. One such 
system, which has restricted applicability to ultrasound 
machines, is described in U.S. Pat. No. 5,715,823. 

One drawback of such systems is that individual Web 
servers are required for each medical modality unit, making 
it a costly endeavor to share data among a number of 
practitioners. Furthermore, each server is limited in use to 
only the attached type of medical modality. 

Other systems for transferring medical files are adapted to 
accept data from a variety of modalities, but require an 
interface to convert data into transferable signals. One such 
system described in WO 98/24358 converts system binary 
file data from a modality to a compatible file of keystroke 
codes using an adapter. The codes are transferred to a 
computer, which converts the codes to American Standard 
Code for Information Interchange ("ASCII") characters for 
transmission over the Internet to a host computer. This 
muhiple file conversion process is an unnecessary burden, 
however, as current Internet technology does not require that 
information be converted into ASCII format. Presently, the 
Internet accepts binary Extended Binary Coded Decimal 
Interchange Code ("EBCDIC") and ASCII codes. Thus, an 
ASCII adapter is now an unnecessary extra device for 
transmitting medical data. 

In addition to simply receiving the medical information, 
it is often important that a practitioner receive the informa- 
tion in a timely manner, especiafly where a quick diagnosis 
needs to be rendered for patient care. Thus, it is advanta- 
geous for telemedicine systems to rapidly transfer medical 
data. As noted, some current telemedicine systems rely on 
the Internet (i.e., as accessed through its graphically- 
oriented user interface, the World Wide Web) to transfer 
information. However, current Web-based transfer systems 
often suffer from long delays in downloading Web pages 
having complex data, such as large images. This presents a 
particular problem for the rapid sharing of medical infor- 
mation as a typical MRI study, for example, may have over 
100 images, each of which may be 300 to 500 Kb in size, 
loading to a study of 50 to 80 Mb total. 

These transfer times may be enhanced by compression of 
the data prior to transmission over the Internet. Traditional 
compression schemes (e.g., JPEG, GIF and bitmap 
schemes), however, tend to operate at low eflBciencies, Such 
low compression efficiency may only provide for transfer of 
simple data before significant resolution losses and/or the 
truncation of data segments is/are experienced. With the use 
of high efficiency compression methodologies, such as 
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wavelet compression techniques, transfer times can be the data interface. The assembly unit may be used to gather 

reduced twenty fold. Unfortxinately, however, the use of selected portions of the stored medical data (and/or new 

such high compression efficiency schemes is not prevalent data) to form an e-mail package. In some cases, such actions 

among current telemedicine systems. oiay be undertaken in response to instructions from a remote 

Another approach to solving the dilemma of lengthy 5 user unit. Often, the server will include a processing unit, 

e r *u f 1 » ■ 1 -ifx which may be coupled to the assembly unit or the data 

transfer tunes is with the use of electronic mail (e-mail ). • . r c j . j j/ 

*i * . \ * c interface, configured to encode, compress and/or encrypt the 

E-mail provides a user with apparently instant transfer ^^^^^^ ^^^^ ^^^^ assembled ^to an 

times, because information is sent as a package in advan<x. ^.^^^ package, or even prior to being stored). In other 

Using e-mail, studies may be 'pushed to the user so that the configurations, separate processing units may be used for 

files are already available at the ^er s computer when the lo ^^^^ ^^^^^ functions. In any event, various com- 

user IS ready to view the data^By contrast, when a user ^^^^^^^ employed, such as progressive 

requests a Web page through a browser, each page must be compression schemes, wavelet, motion wavelet, MPEG 

separately downloaded. ^^^^^j. ^^^^^^ jp^^ schemes, and the like. In the progres- 

Some current e-mail technologies allow for the point-to- sive schemes, any suitable compression algorithm may be 
point transfer of a variety of data from different modalities. used in a looping fashion to compress the data to a desired 
However, these systems do not operate with a central storage or acceptable size. An e-mail server configured to send the 
system. Without a server database, the operations are lim- user interface and the e-mail package to the remote user unit 
ited. For example, one may not retrieve information about and/or another user unit may also be included. The multi- 
how multiple images relate to one another. Such relationship media medical data stored by the server may be text, image, 
information is essential for studying data from certain overlay, 3-D volume, waveform, curve, video or sound data, 
modalities, such as radiology images, and is required for or any combination thereof. 

compliance with some medical industry standards, e.g., the jhe server may further include a 3-D volumetric render- 

multi-specialty DICOM Standards (as originaUy published j^g element and/or a 3-D surface rendering element for 

by an ACR-NEMA committee sponsored by the American converting 2-D images into 3-D images. Window and/or 

CoUege of Radiology and the National Electrical Manufac- ^^^^^ controls may be included for establishing window 

nirers Association as Digital Imaging and Communications ^nd/or level default values. In some cases, an automatic 

in Medicine (DICOM), NEMA Publications PS e-mail control may be included to direct the e-mail server to 

3.1-PS3.12., by The National Electrical ManufacUirers automatically send any new medical data to the remote user 

Association, Rosslyn, Va., 1992, 1993, 1994, 1995). ^^^^ prescribed intervals. 

The DICOM Standards define the form and flow of Another embodiment provides a medical information 

electronic messages that convey images and related infer- transfer unit that includes a display for viewing a medical 

mation between computers. Therefore, it is desirable for file on a user interface having at least one manipulation 

medical information transfer systems to acquire and transmit element for view control of the medical file, and a browser 

complex data, such as radiology images, in a manner that for communicating with a server having stored therein a 

complieswithDlCOMstandards. See, e.g.,Bidgood, etal., plurality of medical files containing multimedia medical 

"Understanding and Using DICOM, the Data Interchange data. The browser includes a browser enhancement module 

Standard for Biomedical Imaging," J. Am. Med, Informatics configured to request a medical file from the server; 

Assoc., 4:3, 199-212, May-June, 1997. As indicated, decompress, decode and/or decrypt the medical file (if 

however, some systems do not meet this requirement. necessary); transfer the medical file to the display; and/or 

Other medical e-mail systems are limited to purely textual send instructions to the server to assemble and to e-mail 

data forms. An example of a medical information transfer selected medical data from the medical file (which may 

system of this type is described in WO 98/16893. This include clinical data, parameter data, series data, annotation 

system allows a service request to be sent by one operator data, observation data, 3-D volume data, and/or combina- 
through a client system to another operator at a sponsor 45 tions thereof) to a remote user unit that is separate from the 

system. The request may be for some action to be performed transfer unit. 

by the operator at the sponsor system, such as to perform a The browser enhancement module may be a plug-in or an 

test, or to provide authorization therefor, and the like. ActiveX control, where appropriate. Further, it may be 

Although perhaps useful, these textual systems are not configured to instruct the server to assemble selected data 
designed to transfer complex data, such as images and 50 with new data to form a package and to e-mail the package 

multimedia output, generated by many medical modalities. to the remote user unit. This new data may be originally 

Thus, in light of the shortcomings of the various currently acquired by the transfer unit through an associated modality 

available systems, there is still a need for medical transfer interface, 

systems that allow for transfer of complex data firom a Still other embodiments may provide a computer readable 
variety of modalities over e-mail and web browser systems. 55 medium having stored therein a plurality of sequences of 

«^ r^.^ instructlons, which when executed by a processor, cause the 

SUMMARY OF THE INVENTION ^^o^e^r «^rf^^ ^^n.i^ ^i.r.. d n tKr^,„,K tK^ 

processor to pertorm certain steps (e.g., tnrougti the use or 

In one embodiment, a medical information transfer server a browser or otherwise). Among these steps may be included 

is provided. The server is adapted to store multimedia the steps of requesting from a server a medical file on a user 
medical data (e.g., parameter and/or clinical data) and 60 interface having at least one manipulation element for view 

includes a data interface for acquiring the medical data; a control of the medical file, the server having stored therein 

storage unit coupled to the data interface and configured to medical files containing multimedia medical data; 

receive and store the medical data; and a user interface (e.g., decompressing, decoding and/or decrypting the medical file; 

a Web page) for viewing the medical data. In some cases, transferring the medical file to a display; and/or e-mailing 
individual storage subunits may be used for storage of the 65 instructions to the server to assemble and send selected 

parameter and clinical data, respectively. An assembly unit medical data from the medical file from the server to a 

may be coupled to the user interface, the storage unit and/or remote user unit which is separate from the processor. The 
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medical data may be in the form of text, image, overlay, 3-D FIG. 1 illustrates one embodiment of a medical informa- 

volume, waveform, curve, video or sound data, or any tion transfer system configured in accordance with the 

combination thereof. Of course, other embodiments may teachings presented herein. 

provide only the instructions themselves or the instructions p,gs. 2A-2D are block diagrams of various embodi- 

as carried m a data signal by a earner wave. 5 ^^g^,,^ „f ^ ^^^^^ configured in accordance with the teach- 

Accordmg to still further embodiments multimedia mfor- ^ presented herein, wherein FIG. 2A shows a seiver 

mation from a variety of modalmes may be assemb ed and ^^^^^ j^j^ compressed prior to storage. FIG. 2B 

communicated to remote users With improved control by the . u j* • * j **u * 

f , . «ji u shows a server where new data is stored without prior 

combined use of a browser enhancement module, such asa •n.^'^^L u ^ . - 

plug-in or ActiveX control, and a server. A remote user unit ^°'"P''*f^°°' f'^' ''^T ^'^^n'^^u "'"^ 

ihat includes the browser enhancement module may access '° assembled and then stored and FIG, 2D shows a sender 

and manipulate data stored in the seiver by sending instruc- <^»t* assembled and then processed as well as 

tions thereto. In some cases, communication is achieved, at stored. 

least in-part, through an e-mail system integrated with the FIG. 3 is a block diagram of one embodiment of a user 

server, where the server assembles and sends the e-mail unit configured in accordance with the teachings presented 

package. By this design, a user may transfer information -'^ below. 

stored on the user's computer, btit is not limited to e-mail pjo. 4 illustrates one embodiment of a user interface with 

transfers of such stored informauon. Rather, the user may njanipulalion elements configured in accordance with the 

access and congregate a variety of mformation from differ- 3^^,^ 

ent sources (such as the server) or instruct the server to ^ 

retrieve usefiil data from other remote hosts, thereby pro- 20 DETAILED DESCRIPTION 
viding the user or another receiving party with a compre- 
hensive package of information. The Medical Network System and Method for Transfer of 

The benefits of information storage on the server are Information described below is configured to provide a rich 

direct in that the type of information available to a user is variety of image manipulation, viewing and annotation tools 

flexible and may be in compliance with the DICOM Stan- 25 for review of information and transfer of the information to 

dards. In one embodiment, portions of data files are related remote users. The system utilizes browser and/or e-mail 

to other portions of files stored on the server. The server may enhancement units, such as may be embodied in a plug-in 

also store associated information such as specific parameters for Netscape-brand browser interfaces (e.g., Netscape 

used by a modality in deriving medical data, notes and Navigator) or MIME interfaces, or an ActiveX control for a 

observations made by a practitioner, as well as patient 30 Microsoft -brand browser interfae (e.g., Internet Explorer), 

histories. to provide this rich application environment. By incorporat- 

Other embodiments further provide for sophisticated i^^S advanced functionality into a down-loadable browser 

manipulation of data (e.g., medical information). Requested enhancement unit, a user need only have available basic 

data may be received by a user unit through a user interface, computer equipment, such as an off-the-shelf personal com- 

such as a Web page, from a server. The user interface may 35 piiter (PC) equipped with an Internet browser, Furthermore, 

provide a wide selection of view controls for optionally the integrated functionality provided by the present system 

manipulating the manner in which data is displayed. Some allows correspondents anywhere on the Internet to instantly 

or all of these controls may be included in a browser '^^^e the same tool kit. 

enhancement module, which may make up a portion of the The data that is transferred by the operator of a server 

user interface (with the remaining portion of the user inter- 40 configured in accordance with the present teachings may 

face being stored at the server). The server may additionally take numerous forms. Some common formats include text, 

have controls such as 3-D image rendering device to allow images, video, sound, such as audio dictation, waveform, 

for further viewing enhancements. curves, and/or combinations or variations thereof. 

In still a further embodiment, a server and/or a browser Moreover, although the data may pertain to the examination 

enhancement module may be configured to receive complex ^5 of a subject in any number of fields, such as manufacturing, 

data from a variety of sources. To avoid truncation during veterinary science, scientific research, etc., the data is pref- 

transmission of large data files, such as radiology files with erably medically related to a subject's physical condition, 

numerous images, high level compression schemes, e.g. Medical data of this sort may be grouped into various types, 

wavelet compression schemes, may be employed to reduce Clinical data is information acquired by a medical modality 

the size of any transferred data files. In some cases, the 50 during the examination of a patient and relates to the 

enhancement module may be configured to acquire and/or patient *s physical health. Examples of clinical data may 

encode new medical data directly from a medical modality. include radiology images, camera photographs, sound 

The enhancement module may pass such new medical data recordings, and the like. Parameter data is another type of 

to the server along with specific inslmctions regarding how data representing criteria surrounding the acquisition of 

the server is to handle the data. For example, the enhance- 55 clinical data. Parameter data includes the settings of the 

ment module may instruct the server to assemble the new medical modality acquiring the clinical data, relationships of 

data with data stored on the server and send the resulting multiple sets of data such as overlay data, timing of the data 

package to another remote user. In addition, the enhance- acquisition, measurements, coordinates, and the like. The 

ment module may be configured to direct the operation of a parameter data includes some of the infonnation required by 

remote medical modality in deriving medical data. 60 the DICOM Standards for stored and transferred medical 

Other features and advantages of these and other embodi- ^^^^^ medical data may include 3-D volume data; 

ments are discussed in detail below. series data for ail clinical data in a medical series, e.g., 

coronal slices vs. axial slices in a CT exam or echoes as Tl 

BRIEF DESCRIPTION OF THE DRAWINGS ,,i,es vs. T2 slices in an MRI exam; annotation data for 

The present invention is illustrated by way of example, 65 notes made by a practitioner, usually relating to the clinical 

and not limitation, in the figures of the accompanying data; and background data such as patient history and/or 

drawings in which: physical examination information. 
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FIG. 1 illustrates an exemplary iaformation transfer sys- the data interface 22 raay be an Ethernet port). However, 

tem 10 configured in accordance with one embodiment of other communication schemes are suitable for transfer of 

the present invention. A modality 12 is coupled to a server data from modality 12 to server 20, such as serial interfaces, 

20 through a dicomizer 14. A second modality 16 is option- parallel interfaces, RS422 and/or RS432 interfaces, 

aUy coupled to a user unit 50, which unit may communicate 5 Livewire interfaces, IEEE-1394 serial busses, Appletalk 

with the server 20. The user unit 50 may have components busses, ATM busses and/or networks, token ring and/or 

to optionally view, manipulate, store and/or print data con- other local area networks, universal serial buses, PCI buses 

figured by modahty 16 or modality 12. The user unit may ^^^^^^ ^ -^^^^^^^ connections, and the like, 

transfer such data to the server 20 and/or send the mforma- ^ . . , . 

tion to another user 80 through the server 20. The other user ^ow refemng m more detail to the server components 

unit 80 may also communicate with the server 20. It should ^° ^hown m FIG. 2A, a processing unit 24 is coupled m 

be noted that the scope of the present invention anticipates communication v^ath data interface 22. Processing unit 24 

any number of modalities, user units and servers configured provides a mechanism to allow for the compression of data 

in accordance herewith and arranged in various fashions, by a compression component 26 prior to storage. For 

The modalities 12 and 16 may be any type of device that example, processing unit 24 may be a general-purpose 

generates data or data signals related to the examination of processor that transfers data to and from compression com- 

a subject. The subject is preferably a human being or an ponent 26. Altemativcly, processing unit 24 may be a 

animal, but may also be an inanimate object that is being processor configured to execute instructions defined by 

inspected. The modality may perform the direct examination compression component 26 (e.g., where compression com- 

of the subject, where the modality includes a detection ponent 26 is a computer program). The compression of data 

component. Alternatively, the modality may create data or 20 conserves storage space and/or provides for the speedy 

signals from a user's input, where the modality has an input transmission of data to the user unit, whereat the browser 

component such as a keyboard, mouse, microphone, etc. enhancement module to be described below may be used to 

Typically, the modality is a medical device. Medical decompress the data, 

modalities used in radiology include data acquisition equip- embodiment, the processing unit 24 may 

ment for magneuc resonance imagmg (MRI) ^^m^^ 25 ^^^-^^^ convenient algorithms that aUow data ffles to 

tomography (CT), ultrasound (US), nuclear medicme (NM) ^uj^^n. i -.u *j 

and d^itized radiography (DR), computer radiography (CR f^^^ ^^^^P'"'^ f'''- ^ algorithms tend 

and digital fluoro|raphy Other modalities include photo- ^« °f ^^^^ '^^^^"^f^ repeatmg patterns of data with 

graphic devices such as high resolution digital cameras; ^^^^^^^ tokens. A header may be added to the data file as it 

sound capture interfaces such as verbal dictation interfaces, ^ compressed for contaimng information necessary m the 

Sound Blaster™ interfaces, and the like; video capture reconstruction of the file when it is decompressed. In 

interfaces such as Snappy® brand parallel port video capture addition, a header may be included which retains informa- 

devices; flatbed scanners and especially Twain compliant ^lon on the way the data was attained and how one data 

acquisition devices such as Visioneer Paperport®. Still other representation, e.g., an image, relates to another represen- 

modalities are for angiography, radiography, endoscopy, 35 ^^tion in the same set of data, e.g., "series 1, unage 39 and 

microscopy, physical exams and waveform devices to col- ^^^^ ^ ^ 

lect EEG and/or ECG data, such as from Hewlett Packard Generally, compression formats are either high efficiency 
Corporation of Palo Alto, Calif, and American Medical or low efficiency and either lossless or lossy. Lossy com- 
Devices Corporation of Lowell, Mass. In addition, the pression schemes are characterized by components of an 
present invention anticipates other modalities and all of the original image being absent from a reconstructed image after 
aforementioned modalities are by way of example, and are a compression-decompression cycle. Lossless schemes do 
not intended to limit the choices that are or may become not drop any information. Compression levels for any 
available in the art. scheme may be chosen to be in compliance with the Food 
' As shown in FIG. 1, the dicomizer 14 receives data from and Drug Administration (FDA) requirements for a particu- 
modality 12 and conveys the data to server 20 where it may 45 lar application, e.g., diagnostics or referral quality, 
be processed, stored and/or sent to user units. Dicomizer 14 Low compression schemes (i.e., those that do not provide 
is an optional component to the information transfer system significant compression ratios) that may be used include 
that converts the raw data into DICOM compliant data. joint photographic experts group (JPEG) compression 
Dicomizer 14 may be a stand-alone device, or alternatively, schemes that use Fourier analysis-based methods, such as 
may be an integral part of a computer system for controlling 50 the discrete cosine transform, to compress data; graphics 
the operations of the modality. interchange format (GIF) compression schemes, which use 
The server 20 in information transfer system 10 is a LZW algorithms; bitmapped image compression schemes 
computer system that stores medical data and is accessible and tagged image file format (TIFF) compression schemes, 
through a network, e.g., the Internet, an intranet, or an Alternatively, high efficiency compression schemes, such as 
extranet.Asshownvariously in FIGS.2A-2D,server20has 55 wavelet, motion wavelet. Motion Picture Experts Group 
components for handling data in various ways. These com- (MPEG) and/or motion JPEG schemes may be employed, 
ponents include a data interface (DI) 22 to receive newly Use of such high efficienciey schemes may be preferred 
acquired data, a processing unit 24 for manipulating the where storage space and/or transmission bandwidth is lim- 
data, a storage unit 30 for retaining (i.e., storing) the data, an ited. For example, wavelet compression schemes may be 20 
assembly unit 32 for gathering together information and an 60 times more efficient than JPEG compression schemes, pro- 
e-mail server 36 for sending the information so gathered. viding for a more detailed representation of the data at the 
Upon review of this specification, it will be appreciated by same bit budget. 

those skilled in the art that the components of server 20 may In one embodiment, a progressive compression scheme is 

be connected in other ways in addition to those described used prior to storage of data, wherein data is incrementally 

and shown in FIGS. 2A-2D. 65 compressed to varying sizes. An advantage of progressive 

In one embodiment, modality 12 may communicate with compression is that where the data is prepared for e-mailing, 

the data interface 22 through an Ethernet connection (i.e., the server may pull the largest size of data that is capable of 
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being compiled into a package. In this manner, truncation by 
intermediate mail hosts causing the loss of data segments is 
avoided. Moreover, the largest acceptable data size also 
provides the optimal resolution for the data when it is 
viewed. 5 

Server 20 is further equipped with a storage unit 30 for 
storing data. In the storage unit 30, data may be constructed 
into a group of related data to form a file. Such files may 
contain a compilation of various forms of data from a variety 
of modalities related to a particular subject or group of 
subjects. 

An assembly unit 32 is coupled to the storage unit 30 for 
gathering selected medical data and the appropriate user 
interface pages to form an e-mail package in response to 
instructions from a remote user unit. The assembly unit 30 
pulls appropriate medical data from the storage unit 30 and 
compiles the data. In one embodiment, the assembly unit 30 
only groups the information but does not arrange the infor- 
mation in the order in which it will be viewed by a user unit. 
Instead, software, e.g., a browser enhancement module, at 
the user unit rearranges the information for viewing. 

A user interface (UI) 34, such as a Web page, is provided 
to the assembly unit 32 for collection into the e-mail 
package. The user interface 34 may be a complete or 
incomplete page. Preferably the interface is an incomplete 25 
interface and the remaining portion of the user interface is 
provided by a browser enhancement module in the user unit. 
The interface 34 may be a group of interface pages that are 
connected by hypertext or other links. 

The Web page(s) that make up UI 34 may be organized in 30 
tree structure, wherein information is arranged hierarchi- 
cally from general to more specific data. However, the pages 
may also be arranged in a linear structure, wherein one page 
leads to the next page, or the pages may be arranged in a 
random structure. Tree structured Web pages may be used, 35 
for example, where an operator is provided with a list of 
patients' studies. The operator may select from various 
instances of treatment or separate types of data, e.g., labo- 
ratory results, radiology with reports or pathologies. Appro- 
priate related data from an external database may be dis- 40 
played as part of the selected data. 

In the exemplary arrangement shown in FIG. 2A, the 
assembly unit 32 is further coupled to processing unit 24 to 
allow for preparation of the e-mail package for sending. 
Assembling of e-mail packages allows for shorter times for 45 
processing, e.g., compressing and encrypting, the e-mail for 
sending because the entire package is processed as a whole 
rather than as individual items, which would need to be 
attached as various components to the e-mail package. 

To prepare the package for e-mailing, the compression 50 
component 26 of the processing unit 24 may further com- 
press the package into a size that is optimal for e-mailing. As 
indicated above, one method of achieving the proper com- 
pressed data size for e-mail is by adjustable or progressive 
compression. In such schemes, processing unit 24 may 55 
compress the assembled medical data to a default ratio, such 
as 2:1 . The processing unit may then measures the size of the 
compressed medical data package and compare it to the size 
that is required by e-mail. The size required by e-mail is that 
size that allows for the data to be sent without leaving 60 
portions of the data behind. Typical requirements for e-mail 
are about 2 to 3 megabytes. If the current data size is greater 
than the required size, processing unit 24 compresses the 
data a second time. The package size is again measured and 
compared to the required size and this procedure may be 65 
repeated until the data size becomes equal to or less than the 
required size. 
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An advantage of this adjustable compression scheme is 
that truncation of data may be avoided. With prior compres- 
sion schemes, an e-mail package that is larger than the 
required size typically has sections of the data removed from 
the e-mailed package. Thus, the recipient only receives a 
portion of the requested information. Furthermore, adjust- 
able compression allows a variety of modalities to be 
transferred by e-mail because usually medical files from 
different modalities have much more data than the accept- 
able size for e-mail. For example, a typical computed 
tomography file is about 50 megabytes in size and a com- 
puted radiography file is about 10 megabytes in size. Unless 
these relatively large files are compressed to 2 to 3 
megabytes, some of the information is truncated when sent 
through e-mail. The truncated information is not transferred 
and the recipient receives only a portion of the file. 

Processing unit 24 also has an encoding component 28. 
The encoding component 28 converts the data into codes 
acceptable to e-mail. Usually, the data is encoded for Inter- 
net transfer by converting the data into an e-mail attachment 
that is recognized as a MIME binary compliant object. The 
receiving e-mail application recognizes the MIME encoding 
and calls the browser enhancement module to decode the 
attachment. 

In some cases the processing unit 24 may include an 
encryption component to encrypt the data prior to sending it 
through e-mail. A variety of encryption schemes may be 
used such as public key encryption or private key encryp- 
tion. For public key encryption, the server may keep a 
database of public keys in a key registry (e.g., in storage unit 
30). The encoding and/or encrypting components may be 
stand-alone components or software components (separate 
or combined) executed by the processing unit 24. 

Server 20 also includes an e-mail server 36 coupled to the 
processing unit 24 and configured to send the e-mail pack- 
age having the data and at least a partial user interface to user 
units SO and 80. The e-mail server breaks messages into 
packets, e.g., as according to the TCP protocol, and delivers 
the packets to user units 50, 80, such as with the IP protocol. 

In another variation of the server 20, as shown in FIG. 2B, 
the data interface 22 is not coupled to the processing unit 24. 
Instead the data interface 22 is coupled to a storage unit 30. 
In this configuration, the data is not compressed prior to 
storage, but is compressed after storage in preparation for 
transmission (e.g., by e-mail). 

FIGS, 2C and 2D depict further embodiments of the 
server 20 and its components, where the data interface 22 is 
coupled to assembly unit 32. In these configurations, data 
received from the data interface 22 is first assembled into an 
e-mail package. The packaged information may optionally 
be placed into storage and then pushed into the processing 
unit 24 from the storage unit 30 as illustrated in FIG. 2C. 
Alternatively, FIG, 2D shows that the package may be 
directly processed for sending by the processing unit 24 
and/or stored in storage unit 30. From the server, the user 
unit receives the requested information. 

The user unit 50 and server 20 may be in communication 
through a variety of connections. FIG. 3 shows one example 
of a user unit 50 with a server connection 56. Server 
connection 56 may be a telephone line, local area network 
(LAN) or wide area network (WAN). The communication 
link may be also made by a serial line Internet protocol 
(SLIP), point-to-point protocol (PPP), an online service, an 
XDSL link, a satellite or other wireless link, a cable modem, 
an ISDN line, or another communication link. ISDN lines 
are useful because ISDN is a digital technology using copper 
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cable telephone wires so that there is no need to convert baseline features. Typical browser enhancement modules 

information from digital to analog form prior to transmis- provide support for new data types and add operations to the 

sion. Typically, server connection 56 is an HTTP connection. browser. Browser enhancement module 54 is preferably 

User unit 50 includes a platform 51, e.g., a personal ei^^^&r a full page type or embedded and visible type, but any 
computer (PC), such as a Windows™ -based PC, 5 format is possible. 

Macintosh™, or one of a wide variety of hardware platforms Browser enhancement module 54 ts configured to instmct 

that runs the UNIX™ operating system. The user unit 50 server 20 as to how to handle particular medical data and 

further includes a display 58, which is coupled to the files. Depending on the particular application of the transfer 

platform 51 through display controller 59. Display 58 may system, the server 20 may handle the data in many ways, 

be any one of a number of conventional display devices such Instruction component 60 receives requests from the user 

as a liquid crystal display or a video display. For sharp colors and directs the server 20 accordingly, 

and grayscale, display 58 is preferably an SVGA monitor, in some cases as depicted in FIG. 3, user unit 50 may 

with a resolution of 26 dpi or better, and an active area of at generate new data and browser 52 may be used to transfer 

least 17 inches, controlled using a true color video card. The this new data to the server 20. In such cases, instruction 
DICOM Standards have also established specific display 15 component 60 instructs the server as to what to do with the 

preferences and the use of DICOM compHant video display new data. The new data is information that is not yet stored 

devices is contemplated as part of the present invention. in the server 20 and may include an alteration to stored data 

User unit 50 makes use of browser 52, i.e. Web browser in the server 20. Furthenmore, the new data may also be data 

software, for communicating with the server 20. The that had been newly acquired from a medical modality (e.g., 

browser 52 issues a request, e.g., an HTTP request, for a modality 16 in FIG. 1) in communication with the user unit 

particular user interface, e.g., a Web page. The browser 52 50 or data that has been dragged from the user unit, e.g., 

is also used in viewing the user interface. Commercially retrieval from a hard drive, desktop, or an input interface 

available browsers suited for use in accordance with the such as a key board, etc. The dragged data may be dropped 

present invention include Netscape Navigator™ from into a file for transferring to the server 20. 

Netscape Corporation located in Mountain View, Calif.; In order to transfer the new data to the server 20, the 

Internet Explorer™ from Microsoft Corporation located in encoding component 62 of browser enhancement module 54 

Redmond, Wash.; and Lotus Notes'""" from Lotus Develop- codes the data following compression thereof by compress- 

ment Corporation located in Cambridge, Mass. ing component 64. The encoding and compressing schemes 

User unit 50 further includes a browser enhancement may be similar to those employed by the server 20 prior to 

module 54 that runs within the browser 52 of the user unit a data transfer and may employ one or more processor(s) of 

50. The browser enhancement module 54 performs the platform 51. 

necessary tasks to make the data readable or transferable. Instruction component 60 may instruct the server 20 to 

Because the module is preferably an integral part of the store the new data. In such cases, when the server 20 

browser, it provides superior capabilities in interacting with receives the new data, the data is decoded by processing unit 

the browser and Web, as compared to a helper appUcation, 24 and placed into the server's storage unit 30. The server 20 

which runs separately from the browser in its own applica- may also optionally encode the new data in a standard 

tion space. This also provides a convenient way to deliver a DICOM format prior to such storage, 

completed package of integrated tools to the user's desktop. Instruction component 60 may further (or alternatively) 
Enhancement module 54 may be configured for a par- 40 instruct the server to e-mail the new data to a second user 

ticular browser, such as a plug-in for the Netscape unit 80. Although FIG. 1 depicts only two user units, it 

Navigator, or an ActiveX control for Microsoft's Internet should be appreciated that any number of user units may 

Explorer or Multipurpose Internet Mail Extensions (MIME) receive data from the server 20. The operator of user unit 50 

interfaces. Because browser enhancement modules are plat- may provide the names or addresses of those user units to 
form specific, type -specific modules must usually be down- 45 receive the data and instruction component 60 may transfer 

loaded according to a particular unit's operating system and this list to the server 20 with the forwarding instructions. In 

processor platform. However, in one embodiment a single the alternative, a predefined list of destination user units may 

enhancement module 54 includes programs for several types be retained in a database either at the user unit 50 or server 

of browsers. A detector in the enhancement module deter- 20. Optionally, this destination database is automatically 
mines the type of browser on which the component is being 50 updated between related servers. 

run and then configures itself to be the appropriate software. Instruction component 60 may be further configured to 

In this manner the browser enhancement module 54 may be instruct server 20 to merge specific other data with the new 

run consistently across all platforms. Furthermore, the data to form an e-mail package, e.g., for forwarding to a 

browser enhancement module 54 may communicate with the second user unit 80. The specific other data may be data 
server 20 and may automatically update itself In this 55 already stored in storage unit 30 of server 20, data stored in 

manner, all browser enhancement modules may be consis- a remote information system e.g., a hospital information 

tently revised to be of the latest version. Thus, an advantage system (HIS) or radiology information system (RIS), data 

of the present data transfer system over those of the past is stored in a third parly tele medicine package, or the like, 

that the necessity of using a myriad of different software Alternatively, the instruction component 60 may instruct 
tools or workstations for each type of data generated by <so server 20 to send only specific other data without any newly 

various modalities is avoided. All of the necessary compo- added data. 

nents are embedded in the browser enhancement module 54 Enhancement module 54 further includes a request com- 

and the server 20. ponent 66 configured to solicit data or other information 

Browser enhancement module 54 adds functionality and from the server 20, When such data is received, the data 
interactivity to a user interface by integrating code, usually 65 must be processed in order for it to be viewed. Thus, 

in a seamless manner. The code module appears as extended decompression component 68 is included to reconstruct the 

capabilities of the user interface, undistinguishable from its original file so that it may be used by user unit 50. Decom- 
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pression component 68 niay examine the e-mail package as Another category of controls is a position group for 

well as any tokens in the data file to accomplish this result. changing the position of an image. Such position changers 

In addition, a decode component 70 may convert the e-mail include a mirror control 110 for obtaining the mirror view of 

into a readable form. If the data was encrypted by the server, an image. By activating the mirror control 110 an image may 

then the enhancement module 54 must also decrypt the 5 be flipped over. The image may be rotated by a rotate control 

message. jl2, preferably by a quarter turn with each depression of the 

Enhancement module 54 may also include a user interface rotate control 112. In addition, where the server 20 includes 

72 with one or more interface pages 73, e.g., Web pages, ^n element for converting a 2-D image to 3-D volumes 
having various manipulation elements 74 for dictating how ^nd/or surfaces, a 3-D control 114 may access the 3-D 
the data is viewed within the user interface. In one jj^age. The server 20 optionally includes a 3-D volumetric 
embodiment, the enhancement module 54 has a portion of a rendering element to depict the internal makeup of a subject 
user mterface 72 with the manipulation elements 74 and the a^d/or surface rendering elements to show the 3-D version 
server 20 has the remaining portion of the user interface. The t^e surface area of a subject. Through the use of these 3-D 
server 20 transfers its portion of the user mterface to the user elements, a 2-D image captured by the server 20 may be 
unit 50 and the enhancement module 54 merges these ^5 converted and stored as a 3-D depiction of the image. This 
portions together to form a complete user interface. 3,^ image may then be e-mailed to a user unit. 

Manipulation elements 74 are used by the operator to alter ^^^^^^^ manipulation elements is the inspec- 

the display of information or data, typically by selecting the ^.^^ ^^^j ^^.^^ facilitates the examination of the images, 

controls as they appear on the user im^^^^ ^ measurement control 116 provides linear distances 

other user control device. FIG, 4 lUustrates one completed 20 between any given points on an image. In one embodiment, 

user interface page 73 with a plurality of manipulation ^^^^^^ ^ ^ ^ ^^^^ ,^ ^ 

elemems 74. The enhancement module 54 may provide for .^^ • measurement control 116 

any desired number of manipulation elements 74, typical y ^^^^^^^^ determines the length so traced and displays such 

being from 1 to 50, more typicaUy from 4 to 25 and tisually measurement to the user. Similarly, the measurement control 

at least four elements, t should be appreciated that UI page 25 116 may also determine the area of a selected region on the 

73 represents a visual display that may be presented on ^ ^ ^^^^^ embodiment, the measurement control 
display 58 (e.g.. a screen shot) and which may be created ^^^^ ^ ,^ ^^^^^i^^ between two 
using programimng techniques familiar to those of ordinary ^^^(^^^ j^^^^ y^^^ ^p^^^j^^ ^1^^, ^ 

the art. vector and move the cursor, typically with a mouse, from the 

One set of manipulation elements 74 is a screen control 30 original vector to a second vector. In this manner, the angle 

group for govermng the manner m which data fills the deviation between the first vector and second vector is 

screen. Any data format may be viewed, such as images, presented 

waveforms, etc. A number index allows the operator to ^ .1^101 .-.ir 

, . . f , , . . * Locator line control 118 is also an inspection tool for a 

select the number of data representations that occupy the ^ . crMr^^xM i^Mm ■ ^ • . i_ 

rir^ ^ J • * . 1 J * * • scout view of DICOM MRI images or CT images to show 

screen. FIG. 4 depicts twelve data representations m the 35 , , . . . , , . r^.. • 

c r J- 1 • -.u TTt ^-1 L * where two images mtersect Within a Study. Other inspection 

lorm 01 radiology images 75 within UI page 73, but any , , 1 ./ 1 c • 

. r * *■ u 1 * J Tn- * tools may provide the angle, area and/or volume 01 portions 

number of representations may be selected. The operator ^ • j 1 .1 . 

„ , • u / . • • c of an image. Furthermore a end scale control 120 may be 

may scroll to obtain subsequent representations in a senes of , , . . .-^ 

u J * • ci 17 * * used to display a grid over the images, e.g., to be used as a 

such data in a file. For every representation, the portion that . r a / 1 • .i_ 

%u- TTT I, A' . i u measurement reference. Another control inverts the gray- 
appears within the UI page 73 may be adjusted by a 40 , r • ... . • . • 

. , „ , * 1 Tt * • J n 1 * 1 scale of the image so that certain aspects of an image may 

window/level control 102. Using the window/level control , '\^ 1 u u • *u * . 

n . . ^ . . . . become more visible. For example, by changing the contrast 

102, the size of the wmdow may be changed and the r • . • * r . j . i_ 

. . , , , , , .u J- 1 u w I of an image, certain aspects thereof may stand out because 

honzontal level that appears on the display may be altered. , ° . i n- .1 1 r 

^^.'^r , , 1 . r c • .u dilierent tissues are displayed with different levels of gray. 

Where the server 20 includes an element for fixing the a ^ l . . 1 i-^'^ h . 

, J, -in 1 An edge enhancement control 122 allows an operator to 

default value for the window and level, the window/level 45. .li ru Lj--it_ .r 

^ ^ tnr* *u r J r u 1 choose thc degree of sharpness by digital enhancement of 

control 102 may vary the setting from its default value. The . T .u r j r .u • 

11 • 1 J .u- J J/ 1 1 the images and smoothness of the edges of the images, 

server 20 optionally includes this window and/or level ^ & & 

default element for setting default values in Hounds Field Still another set of controls is for making annotations to 

units. When the data is sent to a user unit, it appears on the displayed image. Both an arrow control 124 and a 

user's display at the default window and level and control 50 freehand control 126 may be provided for creating lines on 

102 is used to adjust this value image. Such annotation may be erased by clicking clear 

Another screen control element is a cine control 104, f°°^°l ""'^ hidden from the display, by manipulating 

which allows multiple images in a series to be stacked and ^^^^ ^^'^^^^i ^ *^^P^^°". ^^^^^^^ ^ 

viewed as fast moving figures layered one on top of the ^^^^^ ^° ^^^^^^^ especially next to lead hnes pointing 

other. The cine control 104 is especially usefiil for echo in 55 aspects of the unage Other tools for annotation 

ultrasound data. By applying the cine control 104, an "^^^ ^ multi-media controls 132 for recording, stopping 

operator may drag a cursor, e.g., using a mouse or other ^ec^^drng and/or playing back verbal notes, 

cursor control device, over the image slices to repeatedly flip embodiment, the present system provides real time 

them in order or reverse order. To further control the display communication between correspondents. Where both corre- 

of data, a magnification control 106 provides for enlarge- 60 spondents access the same patient records at the same time, 

ment of a region of interest, i.e., a selected portion (e.g., each correspondent may select, for example, by chcking a 

using a magnification boundary under user control) of the manipulation element, to view each other's annotations 

image. A zoom control 108 also is provided to increase the and/or to study the manipulations in real time, 

size of the entire screen. Conveniently, an operator my select After viewing the image, the data may be saved to a local 

a percentage of zoom, e.g., from 200% to 600%, inclusive, 65 hard drive by save control 134, printed by print control 136 

in any of a variety of increments, e.g., increments of 10%, and/or sent to another location via the server 20 by e-mail 

20%, 25%, 50%, etc. control 138, as described in detail above. As an added 
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feature, an HL7 report associated with images may be ing data. For example, the server 20 may notify the practi- 

viewed by a report control. tioner when new information regarding a particular patient, 

Further to the embodiment shown ia FIG. 1, the present has arrived or when a study has been read by another 

system anticipates the optional direct connection of medical practitioner or is waiting to be read, 
modality 16 to user unit 50 through a modality interface 76 ^ xhe server 20 may also integrate synchronous asymmetric 

(shown in FIG, 3), An application code in the browser replication (SAR) of data between the databases of multiple 

enhancement module 54 allows a variety of modalities to be servers to create a distributed database architecture between 

in direct communication with a user unit 50. In this manner, servers. SAR may manage the distribution of information 

the user unit 50 may capture data from many different data across a wide area network or between two or more servers, 

sources. In some embodiments, the modality may be a jhe SAR technology may also use complex rules and 

scanner, a video capture device, a scope, an ECG machine, algorithms to regulate the sequence of data updates and to 

an ultrasound machine or a digital camera. The modality recover from interruption in communication links between 

interface 76 on the user unit 50 may be a serial port, servers in a geographically distributed network, 

universal serial bus (USB), or the like, depending on the According to yet a further embodiment, the storage unit 

particular connection between the modaUty 16 and the user 15 3Q ^^^^^ 20 may include storage subunits for keeping 

particular types of data. A clinical storage subunit may be 

In addition, the enhancement module 54 provides for the provided for storing clinical medical data and a parameter 

direct control of the operations of a variety of medical storage subunit for storing parameter medical data. The 

modalities by a modality control unit 78. Through this unit, parameter subunit may include a header having information 
the user unit 50 may control a plurality of modality '^^ relating the parameter data to the appropriate clinical data, 

operations, such as the settings during data acquisition, Other storage subunits may exist to store various types of 

on/off, etc, depending, for example, on the type of modality data forms. For example, particular subunits may be pro- 

16 and particular application of the user unit 50. For vided for 3-D volume data, series data, annotation data and 

example, where the modality is a digital camera, the user background data. However, the storage subunits are optional 

unit may choose the frames of the film to be uploaded into aspects of the present system. In some embodiments all data 

the user unit 50 and then optionally clear the camera's is stored in one central storage unit and not individual 

storage area. In this manner, an operator may perform an subunits. 

examination with the browser enhancement module 54, The server 20 may also have a protocol database, espe- 

through a modality 16 from a remote location. cially in the clinical field, to build and retain guidelines 

Referring again to FIG. 1, the second user unit 80 may be which practitioners may follow in collecting the required 

the recipient of e-mail from the server 20. The second user information for a particular procedure, illness, patient 

unit 80 includes an e-mail program that reassembles the complaint, etc. The guidelines may direct a practitioner to 

messages so that the information can be read, for example, the correct processes in gathering any relevant information 

by using TCP protocol. The second user unit 80 may also such as patient history, physical examinations, laboratory 

download the browser and e-mail enhancement module 54 tests, procedures to facilitate a medically sound opinion, and 

in order to access any transferred images. Although FIG. 1 the like. For example, a general practitioner desiring to 

shows only two user units, in variations of the transfer consult with an orthopedic surgeon about persistent low 

system 10, any number of user units may communicate with back pain would select "orthopedic surgery" and then the 

the server 20 in the same manner as user units 50 and 80. name of the relevant hospital from a clinical protocol list. In 

Preferably the number of user units is one to several thou- this example, the protocols are listed by chief complaints, 

sand units and more usually about 1 to 100 units. By selecting "low back pain," the practitioner is provided 

There are many alternative features that may be added to with the required tests, history, physical examination data to 

information transfer system 10 to advance the functionality render a recommendation. These lists are available to a 
of the system. Having described the overall system, some 45 practitioner through e-mail from another practitioner or by 

optional aspects of the system will now be discussed. uploading the information from the server 20. 

In one alternative/optional embodiment, the server 20 The protocols may be gathered from the server 20 through 
automatically e-mails information to user units on scheduled any number of sources. One way to derive the information 
intervals or whenever new data is received by the server. For is by converting existing libraries of clinical pnDtocols from 
example, the server 20 may have a list of users with their 50 other servers. These other servers may update the present 
patient names. When the server 20 receives data relating to server by using SAR, or the like. In this manner, clinical 
a particular patient, the server 20 identifies the appropriate protocols may be published to all servers in a network for 
users to receive the data regarding that particular patient. use to any practitioner, especially where a generalist desires 
The server 20 may then automatically send the information to generate a specialty consultation, 
to these users as it is received or at predetermined time 55 Another source of clinical protocols is by a Web -based 
intervals, for example by transferring to the user units author interface allowing a practitioner to publish the pro- 
associated with the appropriate users those user interfaces tocols to a server. The author interface is preferably built into 
(e.g., Web pages) that have changed since the user's last the browser enhancement module 54, but may also be 
visit. The data then resides locally on the user unit and may located on the server 20. The interface allows an operator to 
be viewed without first connecting to the server 20. The go start from a generalized framework of the protocol to be 
pages with data may also be viewed more quickly than if the created or to be edited and republished. A completed pro- 
pages were stored only at server 20, because the pages are tocol is published to the server and becomes the protocol of 
read at high speed from the user unit's hard drive (or other choice for that topic, when addressed to a particular 
long term storage device) rather than across slow wires of practitioner, institution, the entire healthcare system, etc, 
the Internet or another network, 55 The author interface allows practitioners to provide 

In another embodiment, server 20 alerts, such as by using instant improvements to clinical protocols, publish new 

alphanumeric pager, a practitioner with the status of incom- protocols, retire obsolete protocols, etc., without having to 
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intervene with current software programs. By internalizing 
the interface into the browser enhancement module, the 
application is not restricted by current browser technology 
limitations, such as the ability to create new fields in the 
clinical protocols. 5 

In alternative embodiments of the user unit 50, an e-mail 
server may be located in the user unit for viewing mail sent 
from the server 20 to the user unit 50. Furthermore, the user 
unit 50 may have an e-mail enhancement module which has 
attributes similar to those described above with respect to 
the browser enhancement module to enhance viewing of the 
user interface. Such an enhancement module is especially 
useftil for MIME compliant e-mail servers. However, the 
e-mail component need not send instructions from the user 
unit 50 to the server 20, rather the e-mail component need 
only retrieve messages. 15 

Thus, the present information transfer system builds upon 
the browser, browser enhancement module and e-mail com- 
ponent of the server, as each described above, to provide an 
interactive collaboration between consultants by linking 
their actions, annotations and dictations on the same patient, 
The system allows the correspondent to save a scripted 
multimedia annotation to a patient folder and upload it to the 
server or e-mail it with the study to another correspondent. 
The other correspondent may then play back the annotation 
and then respond with his own. 

The present invention has been described above in varied 
detail by reference to the particular embodiments and fig- 
ures. However, these specifics should not be construed as 
limitations on the scope of the invention, but merely as 
illustrations of some of the presently preferred embodi- 
ments. It is to be further understood that other modifications ^0 
or substitutions may be made to the described information 
transfer system as well as methods of its use without 
departing from the broad scope of the invention. Therefore, 
the scope of the invention should be determined by the 
following claims and their legal equivalents. 35 

What is claimed is: 

1. A medical information transfer server comprising: 

A) a data interface for acquiring medical data in a 
muhimedia format; 

B) a storage unit coupled to receive and store the multi- 40 
media medical data from the data interface; 

Q at least a portion of a user interface to allow for 
viewing the multimedia medical data; 

D) an assembly unit coupled to the user interface and the 
storage unit or to the data interface, the assembly unit 45 
to gather selected portions of the multimedia medical 
data to form an e-mail package in response to an 
instruction received from a remote first user ujiit; 

E) a processing unit coupled to the assembly unit or to the 
data interface and to encode and/or compress the mul- 50 
timedia medical data; and 

F) an e-mail server to send by e-mail the user interface 
and the e-mail package to a remote second user unit. 

2. The medical information transfer server of claim 1, 
wherein the multimedia medical data comprises image, 
overlay, 3-D volume, waveform, curve, video, and/or sound 
data, or any combination thereof. 

3. The medical information transfer server of claim 1, 
wherein the selected portions of the multimedia medical data 
are gathered from the storage unit. 

4. The medical information transfer server of claim 1, 
wherein the selected portions of the multimedia medical data 
include new data received from the data interface. 

5. The medical information transfer server of claim 1, 
wherein the selected portions of the multimedia medical data 
include new data received from the remote first user unit. 65 

6. The medical information transfer server of claim 1, 
wherein the user interface comprises a Web page. 
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7. The medical information transfer server of claim 1, 
wherein the processing unit is further to encrypt the multi- 
media medical data. 

8. The medical information transfer server of claim 1, 
wherein the processing im it is to compress the multimedia 
medical data using a progressive compression scheme prior 
to sending the e-mail package, 

9. The medical information transfer server of claim 1, 
wherein the processing imit is to compress the multimedia 
medical data using at least one of a wavelet, a motion 
wavelet, an MPEG or a motion JPEG compression scheme. 

10. The medical information transfer server of claim 1, 
wherein the processing unit is to compress the multimedia 
medical data by: 

(i) compressing the medical data to a default ratio; 

(ii) measuring the size of the compressed multimedia 
medical data; 

(iii) comparing the size of the compressed multimedia 
medical data to a required size; and 

(iv) repeating (i) through (iii) using the compressed 
medical data until the compressed multimedia medical 
data achieves the required size or smaller prior to 
sending the e-mail package. 

11. The medical information transfer system of claim 1, 
wherein the multimedia medical data includes clinical data 
and parameter data. 

12. The medical information transfer system of claim 11, 
wherein the data storage unit includes a clinical data storage 
subunit for storage of the clinical data and a parameter data 
storage subunit for storage of the parameter data. 

13. The medical information transfer system of claim 1, 
wherein the server further comprises a 3-D volumetric 
rendering element and 3-D surface rendering element to 
convert 2-D images into 3-D images. 

14. The medical information transfer system of claim 1, 
wherein the server further comprises a window and/or level 
eleraent(s) for establishing window and/or level default 
values. 

15. The medical information transfer system of claim 1, 
wherein the server further comprises an automatic e-mail 
control to direct the e-mail server to automatically send new 
medical data to the remote first user unit at prescribed 
intervals. 

16. A medical information transfer unit comprising: 

A) a display for viewing a medical file on a user interface 
having at least one manipulation element for view 
control of the medical file, and 

B) a browser for communicating with a server having 
stored therein a plurality of medical files containing 
multimedia medical data, the browser including a 
browser enhancement module to: 

(i) request the medical file from the server; 

(ii) decompress and/or decode the medical file after 
receipt from the server; 

(iii) transfer the medical file to the display; and 

(iv) send instructions to the server to assemble and to 
e-mail selected multimedia medical data from the 
medical file and at least a portion of a user interface 
stored on the server to a remote user unit separate 
from the information transfer unit. 

17. The medical information transfer unit of claim 16, 
wherein the browser enhancement module comprises a 
plug-in or ActiveX control. 

18. The medical information transfer unit of claim 16, 
wherein the browser enhancement module is further to 
decrypt the medical file after receipt from the server 

19. The medical information transfer unit of claim 16, 
wherein the medical file includes clinical data, parameter 
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data, series data, annotation data, observation data, 3-D 
volume data, and/or combinations thereof. 

20. The medical information transfer unit of claim 16, 
wherein the browser enhancement module is further to 
instruct the server to assemble the selected data with new 5 
data to form an package and to e-mail the package to the 
remote user unit. 

21. The medical information transfer unit of claim 20, 
wherein the transfer unit further comprises a modality 
interface for acquiring the new data. 

22. A medical information transfer system, comprising: 10 

A) a server storing multimedia medical data, the server 
comprising: 

i) a data interface for acquiring the multimedia medical 
data; 

ii) a storage unit coupled to receive and store the 
raullimedia medical data from the data interface into 
medical files; 

iii) at least a portion of a user interface for viewing the 
multimedia medical data; 

iv) an assembly unit coupled to the user interface and 
the storage unit or to data interface, the assembly unit 
to gather selected portions of the multimedia medical 
data to form an e-mail package in response to 
instructions received from a first user unit; 

v) a processing unit coupled to the assembly unit or to 
the data interface and to encode and/or compress the 25 
multimedia medical data; and 

vi) an e-mail server to send by e-mail the at least 
portion of the user interface and the e-mail package 
to a second user unit. 

B) the first user unit comprising: 30 

i) a display for viewing at least a first one of the medical 
files using a user interface having at least one 
manipulation element for view control of the first 
medical file, and 

ii) a browser for communicating with the server, the 35 
browser including a browser enhancement module 
to: 

a) request the first medical file from the server; 

b) decompress and/or decode the first medical file; 

c) transfer the first medical file to the display; and 

d) send instructions to the server to assemble and to 
e-mail the selected portions of the multimedia 
medical data from the first medical file and the at 
least portion of the user interface to the second 
user unit. 

23. The medical information transfer system of claim 22, ^5 
wherein the browser enhancement module is further to 
decrypt the first medical file. 

24. The medical information transfer system of claim 22, 
further comprising a medical modality for generating the 
multimedia medical data. 50 

25. TTie medical information transfer system of claim 24, 
wherein the medical modafity comprises radiology equip- 
ment. 

26. The medical information transfer system of claim 22, 
further comprising at least two different types of medical 
modalities for generating the multimedia medical data. 

27. The medical information transfer system of claim 24, 
wherein the medical modality is communicatively coupled 
to the data interface for transmitting the multimedia rnedical 
data to the server. 

28. The medical information transfer system of claim 27, 
wherein the medical modality is communicatively coupled 
to the data interface through a dicomizer to convert raw 
multimedia medical data provided by the medical modality 
into multimedia medical data of a form compliant with the 
DICOM Standards, 65 

29. The medical information transfer system of claim 24, 
wherein the medical modaUty is communicatively coupled 



to the first user unit, and wherein the browser enhancement 
module is further to encode data received from the medical 
modahty. 

30. The medical information transfer system of claim 22, 
wherein the browser enhancement module is further to 
encrypt the multimedia medical data. 

31. Tht information transfer system of claim 29, wherein 
the browser enhancement module is further configured to 
direct more than one operation of the medical modality, 

32. The medical information transfer system of claim 29, 
wherein the browser enhancement module is further to 
encrypt the data received from the medical modality. 

33. The medical information transfer system of claim 22, 
wherein the processing unit is to compress the multimedia 
medical data using at least one of a wavelet, a motion 
wavelet, an MPEG or a motion JPEG compression scheme. 

34. The medical information transfer system of claim 22, 
wherein the processing unit is to compress the multimedia 
medical data by: 

{) compressing the multimedia medical data to a default 
ratio; 

II) measuring the size of the compressed multimedia 
medical data; 

III) comparing the size of the compressed multimedia 
medical data to a required size; and 

IV) repeating (I) through (HI) using the compressed 
multimedia medical data until the compressed multi- 
media medical data achieves the required size or 
smaller prior to sending the e-mail package. 

35. The medical information transfer system of claim 22, 
wherein the server further comprises an automatic e-mail 
control to direct the e-mail server to automatically send new 
multimedia medical data to the first user unit at prescribed 
intervals. 

36. The medical information transfer system of claim 35, 
wherein the server further comprises a mailing list of users 
designated to automatically receive the new multimedia 
medical data. 

37. A computer readable medium having stored therein a 
plurality of sequences of instructions, which, when executed 
by a processor, cause the processor through a browser to: 

A) request from a server a medical file for viewing with 
a user interface having at least one manipulation ele- 
ment for view control of the medical file, the server 
having stored therein medical files containing multi- 
media medical data; 

B) decompress and/or decode the medical file; 

C) transfer the medical file to a display; and 

D) c-mail instructions to the server to assemble and send 
by e-mail selected multimedia medical data from the 
medical file and at least a portion of the user interface 
from the server to a remote user unit separate from the 
processor. 

38. The computer readable medium of claim 37, wherein 
the multimedia medical data is in the form of image, overlay, 
3-D volume, waveform, curve, video or sound data, or any 
combination thereof. 

39. The computer readable medium of claim 37, further 
including additional steps, which, when executed by the 
processor, cause the processor to decrypt the medical file, 

40. The computer readable medium of claim 37, wherein 
the decompressing is performed using a wavelet, a motion 
wavelet or a motion JPEG decompressing scheme. 

41. Computer readable instructions, which when executed 
cause a processor to: 

A) request from a server a medical file viewable using a 
user interface having at least one manipulation element 
for view control of the medical file, the server having 
stored therein medical files containing multimedia 
medical data; 
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B) decompress and/or decode the medical file; 

C) transfer the medical file to a display; and 

D) e-mail instructions to the server to assemble and e-mail 
selected multimedia medical data from the medical file 
and at least a partial user interface from the server to a ^ 
remote user unit separate from the processor. 

42. The computer readable instructions of claim 41, 
wherein the multimedia medical data is in the form of image, 
overlay, 3-D volume, waveform, curve, video or sound data, 

or any combination thereof. lo 

43. A series of computer readable instructions embodied 
as data signals in a carrier wave, which when executed cause 
a processor through a browser to: 

A) request from a server a medical file viewable using a 
user interface having at least one manipulation element 15 
for view control of the medical file, the server having 
stored therein medical files containing multimedia 
medical data; 

B) decompress and/or decode the medical file; 

Q transfer the medical file to a display; and 20 
D) e-mail instructions to the server to assemble and e-mail 
selected muUimedia medical data from the medical file 
and at least a partial user interface from the server to a 
remote user unit separate firom the processor, 

44. The series of computer readable instructions of claim 25 
43, wherein the multimedia medical data is in the form of 
image, overlay, 3-D volume, waveform, curve, video or 
sound data, or any combination thereof. 

45. A method, comprising: 

A) receiving new medical data through a browser 30 
enhancement module; 

B) encoding and/or compressing the new medical data 
using the browser enhancement module; 

C) sending the new medical data to a server; and 

D) instructing the server to e-mail a medical file having 
the new medical data and selected stored multimedia 
medical data and at least a partial user interface to a 
second user unit. 

46. Ilie method of claim 45, wherein the new medical 
data is received from a medical modality to be controlled 40 
using the browser enhancement module. 

47. The method of claim 45, further comprising encrypt- 
ing the new medical data after compressing the new medical 
data. 

48. The method of claim 45, wherein the new medical 45 
data is compressed using one of a wavelet, a motion wavelet 

or a motion JPEG compression scheme. 

49. The method of claim 45, wherein the new medical 
data is compressed using a progressive compression scheme 
wherein: 

50 

A) the new medical data is compressed to provide com- 
pressed medical data; 

B) the size of the compressed medical data is compared to 
a required size; and 

Q steps A and B are repeated using the compressed 55 
medical data until the size of the compressed medical 
data is the required size or smaller. 

50. A series of computer readable instructions embodied 
as data signals in a carrier wave, which when executed cause 
a processor through a browser to perform the steps of: 

A) receiving new multimedia medical data from a medical 
modality; 

B) encoding the new multimedia medical data; 

Q compressing the new multimedia medical data; 

D) requesting from a server, a user interface having at 65 

least one manipulation element for viewing control of 

the new multimedia medical data; and 
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E) transferring the new multimedia medical data onto the 
user interface and sending the new multimedia medical 
data and user interface to the server. 

51. The series of computer readable instructions of claim 
50, further including instructions to cause the processor to 
direct the operation of the medical modality. 

52. The series of computer readable instructions of claim 
50, further including instructions to cause the processor to 
select stored medical data from the server and to direct the 
server to assemble the new multimedia medical data with the 
selected stored data and electronic mail a medical file 
including both the new multimedia medical data and the 
selected stored medical data to a remote user unit. 

53. The series of computer readable instructions of claim 
50, wherein the new multimedia medical data is in the form 
of image, overlay, 3-D volume, waveform, curve, video or 
sound data, or any combination thereof. 

54. The series of computer readable instructions of claim 
50, fiirlher including instructions which cause the processor 
to encrypt the new multimedia medical data after compress- 
ing the new multimedia medical data. 

55. The series of computer readable instructions of claim 
54, wherein the new multimedia medical data is compressed 
using one of a wavelet, a motion wavelet or a motion JPEG 
compression scheme. 

56. The series of computer readable instructions of claim 
50, wherein compressing the new multimedia medical data 
includes the steps of: 

A) compressing the new multimedia medical data to a 
default ratio to achieve compressed data; 

B) measuring the size of the compressed data; 

C) comparing the size of the compressed data to a 
required size; 

D) further compressing the compressed data if the size is 
greater than the required size; 

E) repeating steps B to D until the size of the compressed 
data is the required size or smaller. 

57. The series of computer readable instructions of claim 
50, wherein the at least one manipulation element on the 
user interface is a 3-D control and the server further has a 
3-D volumetric rendering element and 3-D surface rendering 
element for converting 2-D images into 3-D images. 

58. A server, comprising: 

A) a data interface for acquiring clinical multimedia 
medical data and parameter medical data; 

B) a clinical data s torage unit coupled to the data 
interface and to receive the clinical multimedia medical 
data; 

C) a parameter data storage unit coupled to the data 
interface and to receive the parameter medical data; 

D) at least a portion of a user interface for viewing the 
clinical multimedia medical data; 

E) an assembly unit coupled to the user interface and the 
storage unit or to the data interface, the assembly unit 
to gather selected portions of the clinical multimedia 
medical data and the parameter medical data to form an 
e-mail package in response to instructions from a first 
user unit; 

F) a processing unit coupled to the assembly unit or to the 
data interface and to encode and/or compress the clini- 
cal multimedia medical data and the parameter medical 
data; and 

G) an e-mail server to send by e-mail the at least portion 
of user interface and the e-mail package to a second 
user unit. 

+ * « * « 
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